Papers with representation learning model
CLUSE: Cross-Lingual Unsupervised Sense Embeddings (D18-1)
Copied to clipboard
| Challenge: | Existing models for learning bilingual sense embeddings that encode semantics are weak for recognizing multi-sense word representations . elucidation of word embeddables is difficult because they do not allow a word to have different meanings in different contexts. |
| Approach: | They propose a sense induction and representation learning model that learns bilingual sense embeddings that align well in the vector space. |
| Outcome: | The proposed model shows that the learned embeddings are aligned well in the vector space. |
PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models (2020.tacl-1)
Copied to clipboard
| Challenge: | PERL is a representation learning model that uses labeled data from the source domain and unlabeled data not necessarily drawn from the target domain. |
| Approach: | They propose a model that extends contextualized word embedding models with pivot-based fine-tuning to address this bottleneck. |
| Outcome: | The proposed model outperforms strong baselines across 22 sentiment classification domain adaptation setups and improves in-domain model performance. |
Pivot Based Language Modeling for Improved Neural Domain Adaptation (N18-1)
Copied to clipboard
| Challenge: | Existing work on domain adaptation does not exploit the structure of the input text . PBLM can naturally feed structure aware text classifiers such as LSTM and CNN . |
| Approach: | They propose a model that integrates pivot-based and NN modeling in a structure aware manner. |
| Outcome: | The proposed model can naturally feed structure aware text classifiers such as LSTM and CNN. |
Modeling Historical Relevant and Local Frequency Context for Representation-Based Temporal Knowledge Graph Forecasting (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing representation-based approaches neglect candidate-specific temporal context, resulting in serious information loss or homogeneous prediction. |
| Approach: | They propose a temporal representation learning model that incorporates temporal contexts of candidates and models temporal contextual information from historiCal Relevant context and locAl Frequency contexT. |
| Outcome: | The proposed model can leverage temporal contextual information to achieve differential predictions on six benchmark datasets. |
A Generative Framework for Personalized Sticker Retrieval (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing relevance-based generative retrieval methods lack personalization, leading to a mismatch between diverse user expectations and the retrieved results. |
| Approach: | They propose a representation learning model that learns discriminative user representations to encode user-specific sticker preferences. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in generating relevant stickers for queries. |